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SMART CLIPPER FOR MOBILE DISPLAYS 

The present invention relates to color displays in mobile devices. In particular, 
the present invention relates to color rendering in mobile displays with limited color 
gamut. Most particularly, the present invention relates to an apparatus and method for 
primary color correction and clipping that is especially directed to displays with limited 
color gamut. 

In regular displays the color gamut is smaller than the gamut of the human visual 
system. This means that some colors that we can see cannot be shown on such a display. 
Especially in mobile (reflective) displays the gamut is small in order to get as much 
brightness as possible out of the display. Typically the displays cover less than 36% of 
the gamut set by the European Broadcast Union (EBU). 

FIG. 2 is an example of an EBU display and FIG. 3 is an example of a mobile 
display having primaries with a saturation of 60% of the saturation of EBU primaries 
(which is 36% EBU gamut), both with the same brightness. The problem is obvious, the 

* 

mobile display has poor color rendering in this example. 

There are a number of possible solutions: other color filters and gamut mapping, 
which can be divided into gamut correction and clipping. 

One solution to the gamut problem could be to increase the gamut of the display 
by making the color filters thicker, i.e. make them more saturated by blocking more 
wavelengths. Of course in an LCD display this will reduce the brightness. In the case of 
a display with ideal color filters the brightness drops by 30%, but in the case of a typical 
mobile display the brightness drop is more than 50%, as illustrated in FIG. 4 v. FIG. 5. 

On a desktop monitor the display with the large color gamut, FIG. 3, might still be 
preferred, but if the brightness of the desktop monitor is reduced to 5-10% of the ambient 
illumination, which approximates a mobile display in a light environment, preference 
shifts to the brighter display illustrated in FIG. 4 because a lot of detail is missed on the 
less bright panel illustrated in FIG. 5. 
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The present invention provides an algorithm to perform Gamut mapping (primary 
color correction and clipping), particularly for displays with a smaller color gamut than 
the incoming video signal, such as mobile displays, by trading-off between color gamut 
and brightness. The essence of the present invention is to use a high brightness small 
color gamut mobile display and perform a gamut correction on the incoming RGB signal 
before sending it to the display drivers. This means that, instead of accepting less 
saturated primaries for the red (R), green (G) and blue (B) signals and thus de-saturating 
all colors, the RGB signal is corrected for the new primaries. Now, the colors of the 
input signal that can be represented on the display are not affected, but as a result of this 
correction, colors that cannot be represented have to be mapped to a color inside the 
gamut. 

Thus, the present invention comprises: 

1 . a primary color conversion; and 

2. a gamut mapping for colors outside the display gamut. 

The foregoing and other features and advantages of the invention will be apparent 
from the following, more detailed description of preferred embodiments as illustrated in 
the accompanying drawings. 

FIG. 1 illustrates a simplified block diagram of a mobile device having a graphics 
module including the gamut mapping with smart clipping according to the present 
invention; 

FIG. 2 illustrates an EBU standard display; 

FIG. 3 illustrates a typical prior art mobile display, which is optimized for 
brightness at the expense of color gamut by using broad-band color filters; 

FIG. 4 illustrates a mobile display optimized for brightness at the expense of color 
gamut by using broad-band color filters; 

FIG. 5 illustrates a mobile display optimized for color gamut at the expense of 
brightness by using narrow-band color filters; 

FIG. 6 illustrates a mobile display of a Portrait image optimized for brightness at 
the expense of color gamut by using broad-band color filters; 
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FIG. 7 illustrates the effect of using gamut correction of the incoming signal for 
the images illustrated in FIG. 3 and 6; 

FIG. 8 illustrates a mobile display of a Parrots image optimized for brightness; 

FIG. 9 illustrates the image of FIG. 7 with a gamut correction of the incoming 
signal; (note the clipping artifacts on the red head and the yellow breast). 

FIG. 10 illustrates a mobile display optimized for brightness; 

FIG. 11 illustrates the display of FIG. 8 with a gamut correction and a brightness 
reduction of the incoming signal; 

FIG. 12 illustrates a mobile display optimized for brightness; 

FIG. 13 illustrates the mobile display of FIG. 8 corrected with a smart clipper 
according to a preferred embodiment of the present invention; 

FIG. 14 illustrates a matlab script implementing gamut mapping with 'smart' 
clipping, according to a preferred embodiment of the present invention; 

FIG. 15 illustrates a modification to the matlab script of FIG. 14 that implements 
peaking according to an alternative preferred embodiment of the present invention; 

FIGs. 16 A-D compare an original EBU display A with a conventional 85% EBU 
display B with the smart clipping of the present invention applied to the conventional 
EBU display C and with both smart clipping and peaking of the present invention applied 
to the conventional EBU display D; and 

FIG. 17 illustrates the matlab script of gamut mapping, 6 smart clipping' and smart 
brightness reduction of FIG. 15 further modified for saturation calculation. 

It is to be understood by persons of ordinary skill in the art that the following 
descriptions are provided for purposes of illustration and not for limitation. An artisan 
understands that there are many variations that lie within the spirit of the invention and 
the scope of the appended claims. Unnecessary detail of known functions and operations 
may be omitted from the current description so as not to obscure the present invention. 

Referring to FIG. 1 A, the graphics processor 101 of a mobile display 104 may be 
modified to perform gamut mapping with smart clipping of an input RGB signal 101 
according to a preferred embodiment of the present invention. The resultant RGB signal 
with "smart" clipping 103 is displayed on the mobile display 104. In this preferred 
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embodiment, the functionality of the gamut mapping with "smart" clipping can be 
implemented in software or hardware within the graphics processor 101. In an alternative 
preferred embodiment, illustrated in FIG. IB, the gamut mapping with "smart 9 ' clipping 
is applied by a dedicated chip 105 to the output signal of a graphics processor 102 and 
both 

the graphics processor 102 and dedicated chip 105 are on-board a mobile device with a 
display 104. Although the description may refer to terms commonly used in describing 
particular mobile display devices, the description and concepts equally apply to other 
processing systems, including systems having architectures dissimilar to that shown in 
FIGs. 1A and IB. 

FIG. 1C illustrates 'smart' clipper either on-board the graphics processor 102 of a 
mobile device or as a standalone chip 105 therein. The 'smart' clipper includes a 
controller/processor unit 106 that processes instructions, performs calculations and 
manages the flow of information and images from and to the network interface 113 and 
from and to the mobile device display 104. Additionally, the controller/processor 106 is 
communicatively coupled with a program memory 107. Included within the program 
memory 107 are a multi-step 'smart' clipper module 108 that controls the selection and 
execution of algorithms: gamma correction algorithms 109, gamut mapping algorithms 
110, smart clipping algorithms 111, and peaking algorithms 112. The 
controller/processor 106 may also manage the network interface 113 for acquiring the 
digital image data and directing its processing by the multi-step 'smart' clipper 
modulel08 and display on the mobile display 104. Additionally, the controller/processor 
106 may store the original and processed digital image data in a data memory (not 
shown) to allow local editing, redisplay and retransmission over the network of these 
images. Notably, the network can be a wireless network or wired network. 

How to transform a signal that is represented by one set of primary color points, 
to another set of primaries, is well known in the art. Consider an incoming video signal 
RGBi (column with Red, Green, and Blue). Let Ai be a 3x3 matrix, having in each 
column the tri-stimulus values (X,Y,Z) of the R(ed), G(reen), and B(lue) primaries of an 
EBU calibrated display. Let A 2 be a similar matrix for a mobile display with limited 
gamut. Then, the matrix multiplication: 
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RGB 2 = (A2)" 1 * Ai * RGB 1 (Eq.l) 
converts the signal from the EBU primaries to the display primaries. For a low-saturation 
mobile display having primaries with incorrect hue this is equivalent to a saturation 
increase (expansion) and a hue correction of the input signal such that it shows the same 
colors on the mobile display as the EBU display for colors that are within its gamut. The 
colors outside its gamut cannot be represented, and have to be mapped to a value inside 
the gamut. In this mapping process,. there are a lot of possibilities. 

The simplest form of this mapping, 'clipping*, where it is assumed that the 
display signals range from 0 to 1, is as follows: 

for each pixel (R,G,B) perform the following mapping 

R(if R<0) = 0, G(if G<0) - 0, B(if B<0) = 0 (Eq. 2) 

R(if R>1) = 1, G(if G>1) = 1, B(if B>1) = 1 (Eq. 3) 

However, clipping can lead to visible artifacts, (color shifts) and the following algorithm 
performs better: 

R(R<0) = 0, G(G<0) = 0, B(B<0) - 0 (Eq. 2') 

R(R>1) = R(R>l)/max(R,G,B), 
G(G>l) = G(G>l)/max(R,G,B), and 

B(B>1) = B(B>l)/max(R,G,B) (Eq. 3') 

reducing the saturation by setting negative values to zero and reducing the brightness by 
scaling with the maximum (R,G,B). This effectively clips the color along a line to the 
black-point ('clip to black'). The hue will not change. 

In comparing images illustrated in FIG. 6 v. FIG.7 the improvement is quite 
striking, yet, in other images such as the 'Parrots 9 illustrated FIG. 8 v. FIG.9, the gamut 
correction and subsequent mapping result in very annoying clipping artifacts. The 
difference between the Portrait images of FIGs. 6 and 7 and the Parrot images of FIGs. 8 
and 9 is that the Portrait mapping has most colors within the gamut of the mobile display, 
whereas the Parrot mapping has many colors outside of the color gamut of the mobile 
display. One can see that the out-of-gamut pixels in the head of the red parrot clip to 
almost the same red color, and similarly for the yellow, which leads to a loss of texture in 
these areas. 
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In order to prevent the clipping artifacts of the gamut correction, one can combine 
it with a brightness reduction. In this way brightness is exchanged back for color again, 
but now "digitally" instead of "physically". This prevents a (possibly large) number of 
pixels with different colors being mapped to the same color, but as a consequence, colors 
inside the gamut are affected too. This is generally referred to as 'soft-clipping', and the 
amount of 'soft-clipping' can always be combined with (the remaining amount of) 'hard- 
clipping' to find a good tradeoff between clipping artifacts and brightness reduction. 
Brightness reduction only prevents clipping for colors that contain an RGB value that 
exceeds the maximum, but since these are (by definition) bright pixels, the effect of 
reducing the clipping artifacts here, can be large. 

In a preferred embodiment, the brightness reduction is accomplished by 
multiplying all pixel values in the image with a factor between 0 and 1. After some trial 
and error a factor of 0.85 appears to provide good results for the images tested (n=10) on 
a mobile LCD display. As can be seen in FIGs. 10 and 11 the clipping artifacts have 
disappeared, but the image is a little less bright. 

In a preferred embodiment, a solution is based on the perceptual attribute 
"colorfulness", which is based on the rule-of-thumb that images that are brighter seem to 
possess more color. In the smart clipping algorithm of a preferred embodiment, a 
brightness reduction is followed by a gamut (primary) correction but instead of 
performing a hard clip on the out-of-gamut values (by clipping values smaller than 0 to 
zero) a smart clip is performed by "adding white" to the out-of-gamut pixels only. This 
reduces the saturation but at the same time it increases the brightness. In other words, in 
a preferred embodiment, the saturation is decreased in favor of increased brightness, 
which gives similar colorfulness on a mobile display as on an EBU display. This smart 
clipping affects those colors that cannot be represented because one of the RGB values is 
smaller than zero. 

The algorithm of this preferred embodiment is as follows: 

• correct for the low-saturation gamut. 

• for pixels with one of R,G,B smaller than 0 the minimum R,G,B value is 
subtracted from the R,G,B (e.g. (255,200,-10) - -10 = (265,210,0)). 

Now, there are no values lower than 0, but still there can be values larger than 255. 
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• a 'clip to black' is performed on the pixels with one R,GJB larger than 255 (e.g. 

(265,210,0) => (265,210,0)*255/265=(255,202,0)). 
FIG. 13 illustrates the final result of employing a "smart clipper" to the mobile display of 
FIG. 12, which has only been optimized for brightness. 

In an alternative preferred embodiment, in order to prevent a reduction in contrast, 
the "adding of white" is scaled with the brightness of the pixel such that dark pixels get 
less white added than bright pixels. 

Clipping can be performed by keeping at least one of the color characteristics 
(luminance, hue, saturation, lightness, colorfiilness, etc) constant during the clipping. 
One way to accomplish this, is to transform the signal to a different space (with some 
perceptually meaningful coordinates), and perform the clipping in that space. Another 
method is to use look-up tables. These methods have the disadvantage that they require 
many operations (e.g. non-linear 'gamma' correction), which is not efficient for mobile 
applications. Therefore, the preferred 'smart-clipping' method is really an efficient and 
effective method to render high quality color images on low-quality mobile displays. 
Especially in the case where the primary colors of the display have roughly the same hue, 
but lower saturation than the EBU primaries, a simple mapping algorithm of a preferred 
embodiment the present invention has the advantage that it does not introduce serious 
color artifacts (color and hue shifts). 

FIG. 14 illustrates a matlab script that performs the gamut mapping and 'smart- 
clipping' color correction. FIGs. 16A-C illustrate the advantage of this embodiment in 
the appearance of a mobile image. FIG. 16A is a conventional EBU image, FIG. 16B is a 
mobile display having 85% EBU saturation, FIG. 16C is the mobile display of the image 
of FIG. 16B modified according to the gamut mapping+smart clipping embodiment of 
the present invention. 

In an alternative preferred embodiment, smart clipping is combined with smart 
brightness reduction. FIG. 15 illustrates a matlab script that implements this alternative 
embodiment of gamut mapping, 'smart clipping' and smart brightness reduction. 

FIGs. 16A-D illustrate the advantage of this alternative embodiment for a mobile 
display. FIG. 16A is a conventional EBU image, FIG. 16B is a typical mobile display 
having 85% EBU saturation, FIG. 16C is the mobile display of the image of FIG. 16B 
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modified according to the gamut mapping+smart clipping embodiment of the present 
invention, and FIG. 16D is the mobile display of image of FIG. 16B modified according 
to the gamut mapping+smart clipping+smart brightness reduction embodiment of the 
present invention. 

Smart brightness reduction can also be referred to as saturation dependent 
attenuation. FIG. 17 illustrates the matlab script of gamut mapping, 'smart clipping' and 
smart brightness reduction further modified for saturation calculation. 

While the preferred embodiments of the present invention have been illustrated 
and described, it will be understood by those skilled in the art that various changes and 
modifications may be made, and equivalents may be substituted for elements thereof 
without departing from the true scope of the present invention. In addition, many 
modifications may be made to adapt the teaching of the present invention to a particular 
situation without departing from its central scope. Therefore it is intended that the 
present invention not be limited to the particular embodiments disclosed as the best mode 
contemplated for carrying out the present invention, but that the present invention include 
all embodiments falling within the scope of the appended claims. 



